Towards a Real-time Gaze-based Shared Attention for a Virtual Agent
نویسندگان
چکیده
This paper investigates work towards a real-time user interface for testing shared-attention behaviours with an embodied conversational agent. In two-party conversations, shared attention, and related aspects such as interest and engagement, are critical factors in gaining feedback from the other party and allowing an awareness of the general state of the interaction. Taking input from a single standard webcamera, our preliminary system is capable of processing the users eye and head directions in real-time. We are using this detection capability to inform the interaction behaviours of the agent and enable it to engage in simple shared attention behaviours with the user and objects within the scene in order to study in more depth some critical factors underpinning engagement.
منابع مشابه
The Dynamics of Referential Speaker Gaze: Order is Important, Synchronization, Not So Much
Gaze is known to be a an important social cue in face-to-face communication indicating interest, focus of attention, emotional states, or intentions to give and take speaking turns [3]. In addition, speaker gaze can also influence object perception [2] and situated utterance comprehension [6] by driving both interlocutors visual attention towards the same object. Such gaze-following can lead to...
متن کاملA Multimodal Real-Time Platform for Studying Human-Avatar Interactions
A better understanding of the human user’s expectations and sensitivities to the real-time behavior generated by virtual agents can provide insightful empirical data and infer useful principles to guide the design of intelligent virtual agents. In light of this, we propose and implement a research framework to systematically study and evaluate different important aspects of multimodal real-time...
متن کاملShared Attention and Interindividual Neural Synchronization in the Human Right Inferior Frontal Cortex
During a dyadic social interaction, two individuals can share visual attention through gaze, directed to each other (eye contact) or to a third person or an object (joint attention). Eye contact and joint attention are tightly coupled to generate the state of shared attention across individuals. Hyperscanning fMRI conducted with pairs of adults during joint attention tasks showed interindividua...
متن کاملNeural substrates of shared attention as social memory: A hyperscanning functional magnetic resonance imaging study
During a dyadic social interaction, two individuals can share visual attention through gaze, directed to each other (mutual gaze) or to a third person or an object (joint attention). Shared attention is fundamental to dyadic face-to-face interaction, but how attention is shared, retained, and neutrally represented in a pair-specific manner has not been well studied. Here, we conducted a two-day...
متن کاملPerceptual Attention in Virtual Humans: Towards Realistic and Believable Gaze Behaviors
Virtual humans, like real humans, need to perceive their environment. They need to be aware of situations in their world so that they can perform tasks, react to contingencies, interact with other agents (both virtual and human), plan, and make decisions about what to do next or at some future time. Humans develop a knack for directing their gaze toward the right objects in the environment at t...
متن کامل